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(54) Multi-media communication apparatus 

(57) A multi-media communication apparatus for 
communicating with a communication partner by using 
various kinds of media including image, voice and data. 
The communication apparatus has a menrx>ry for storing 
information on a communication on each medium, and 
forms and outputs a report for communication manage- 
ment from information on each communication. The 
communication management report can be formed 
manually or automatically and contains communication 
history along with images for identification of communi- 
cation partners. 
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Description 

BACKGROUND OF THE iNVENTION 

Field of the Invention 

This invention relates to a multi-media communica- 
tion apparatus for performing communication by using a 
combination of various kinds of media such as image, 
speech (audio), data (code data) and, more particularly, 
to a multi-media communication apparati^ capable of 
outputting a communication management report con- 
taining communication information on communication 
partners, media used for communication and the like. 

Related Background Art 

Conventionally, in facsimile apparatuses for image 
communication, information on the times when commu- 
nications are performed, the names of communication 
partners and so on is stored in a memory and this infor- 
mation is output as a communication management 
report by an instruction from the operator. 

Recently, a communication service using the Inte- 
grated Service Digital Network (ISDN) has been put to 
practical use. Audio-visual services using a digital line 
such as that of the ISDN therefore attract attention and 
the use of multi-media communication apparatuses 
such as TV telephone sets and TV meeting systems 
capable of communication using multiple media includ- 
ing images, voice and code data is spreading. 

In conventional multi-miedia communication appa- 
rati^ of this kind, communication management is not 
performed and no communication management report 
is formed and output. It is ttierefbre diffrcult to confirm 
the time when a communication is performed, the name 
of the communication partner and media used for the 
confimunication. 

SUMMARY OF THE INVENTION 

In view of the above problem, an object of the 
present invention is to provide a multi-media communi- 
cation apparatus capable of forming and outputting a 
communication management report, whereby commu- 
nication charges and communication history can be 
used for communication management. 

Another object of the present invention is to provkie 
a multi-media communication apparatus in whk:h conv 
munication history is recorded witii respect to media 
such as image, voice and data and output as a report to 
enable communication conditions and changes with 
respect to the media to be easily recognized. 

Still another object of the present invention is to 
provkJe a multi-media communication apparatus which 
enables media used for communications to be easily 
recognized witti respect to the communications. 

A further object of the present invention is to pro- 
vide a nrujlti-media communication apparatus capable of 
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outputting a communication management report t>y 
using as a parameter a medium used for communica- 
tion as a parameter. 

A still further object of the present invention is to 

5 provide a multi-media communication apparatus capa- 
ble of forming and outputting a communication manage- 
ment report by combining communication history data 
and partner's image data. 

A still further object of the present invention is to 

10 provide a multi-media communication apparatus which 
enat)les the operator to store a partner's image to be 
recorded on a communication report without being con- 
scious of this operation as well as to store and record an 
arbitrary partner's image on a communication report. 

15 A still further object of the present invention is to 
provide a multi-media communication apparatus which 
ensures that a communication management report can 
be output without failure and which enables the operator 
to output a communication management report any 

20 time. 

A still further object of the present invention is to 
provide a multi-media communk^ation apparatus which 
enables identification of a communication partner in a 
case where incoming from the communication partner 
25 is received during operator's absence. 

The above and other objects of the present inven- 
tion will become apparent from the following detailed 
description given in conjunction with the acconrpanylng 
drawings. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of the construction of a 
multi-media communication apparatus in accord- 
as ance with a first embodiment of the present inven- 
tion; 

Figs. 2 and 3 are f bw charts of a process for com- 
munication in accordance with the first embodi- 
ment; 

40 Rg. 4 is a cfiagram of communication management 
information registered in a memory in accordance 
with the first embodiment; 
Rg. 5 is a flow chart of a procedure of control at the 
time of outputting a communicatk>n management 

45 report; 

Rg. 6 is a diagram of examples of communication 
managements in accordance with the first en^xxti- 
ment; 

Rg. 7 is a flow chart of the operation of storing corn- 
so munication history in accordance witii a second 
embodiment: 

Rg. 8 is a diagram of contents of a memory in 
accordance with the second embodiment; 
Rg. 9 is a flow chart of report outputting in accord- 
55 ance vyith second embodiment; 

Rg. 1 0 is a diagram of examples of output commu- 
nication management reports in accordance with 
the second embodiment; 

Rg. 11 is a block diagram of the construction of a 
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multi-media communication apparatus in accord- 
ance with a third embodiment of the present inven- 
tion: 

Fig. 12 is a flew chart of a procedure of processing 
for communication in accordance with the third 
embodiment: 

Fig. 13 is a flow chart of a procedure of control at 
the time of storing a partner's image in a memory; 
Rg. 14 is a flow chart of report outputting in accord- 
ance with the third embodiment; 
Fig. 1 5 is a diagram of memory contents in accord- 
ance with the third embodiment; and 
Fig. 16 is a diagram of an example of an output 
communication management report in accordance 
with the third embodiment 

.DE?CRIPTIOfK)FTHE PREFER RED EMBODY 
MENTS 

[Rrst Embodiment] 

First, an example of a system for outputting reports 
as communication results with respect to a several 
kinds of media, i.e.. voice (audio), data and image in 
accordance with a first embodiment of the present 
invention will be described below. 

Rg. 1 is a k>lock diagram of a multi-media communi- 
cation apparatus 1 in accordance with this errtoodiment. 
The multi-media communication apparatus 1 has a 
handset 2 provided as. a voice (audio) input/output 
means and connected to a voice (audio) control section 
3. The voice control section 3 has a voice (audio) 
encoding/decoding section for encoding various voice 
(audio) signals to be transmitted and for decoding 
received voice signals, an on/off-hook detection section 
fa detecting whether the handset 2 is in an on-hook 
state or in an off-hook state, and a voice interface sec- 
tion for generating various tones including a dial tone, 
call tone, a busy tone and an incoming tone. A data ter- 
minal 4 for data communtcation Is connected to a data 
control section 5 which is arranged to perform data 
transmission/reception with the data terminal 4. A cam- 
era 6 is provided as an image input means. A display 
unit 7 displays an input image supplied from ttie camera 
6. an image received through a line 14, operation dis- 
play windows and tiie like. The camera 6 and the display 
unit 7 are connected to an image (video) control unit 8. 
The irnage control unit 8 has an jrr^ge . encoding/decod- 
ing section for encoding image signals to be transmitted 
and for decoding received image signals, and a video 
irrterface section for changing or dividing display win- 
dows of the display section 7. An operation unit 9 having 
a keyboard, a touch panel or the like for inputting for 
overall control of the apparatus 1 is connected to a sys- 
tem control unit 10. The system control unit 10 has a 
CPU 101. a ROM 102, a RAM 103 and an auxiliary 
memory 104 and serves to control and observe the 
whole of the apparatus 1 or execute various application 
programs. The system control unit 10 incorporates, as 



described later, memory means (RAM 103. auxiliary 
memory 104) for collecting and storing communication 
history with respect to each medium, and a formation 
means (CPU 101) for forming a conmunication man- 

5 agement report on a management of communication on 
each medium based on the communication history col- 
lected and stored. An output unit (output means) 11 for 
outputting communication management reports formed 
by the system control unit 1 0 is connected to the system 

10 control unit 1 0. The voice control unit 3, the data control 
unit 5, tiie image control unit 8 and the display unit 7 are 
respectively connected to tiie system control unit 10. 
The voice control unit 3. the data control unit 5 and the 
image control unit 8 are respectively connected to a 

75 multiplex/separator unit 1 2. The multiplex/separator unit 
12 multiplexes a voice signal supplied from the voice 
control unit 3, data from the data control unit 5 and an 
image signal from the image control unit 8 and sepa- 
rates reception frames received through the line 1 4 witii 

20 respect to the media. The multiplex/separator unit 12 is 
connected to a line interface unit 13 for corrtrolling the 
tine in accordance with the ISDN user network Interface. 
The line interface unit 13 is connected to the ISDN 
through the line 14. 

25 A procedure of communication history processing 
at ttie tinne of comnrtunlcation (transmission or recep- 
tion) effected in the thus-constructed multi-media com- 
munication apparatus 1 will be desaibed below with 
reference to the flow chart of Rg. 2. Ck)mmunication his- 

30 tory is first collected by the system control unit 1 0 in step 
SI , and tiie collected communication history is stored in 
the auxiliary storage 104 in step 82. Communication 
history referred to herein includes Information items, 
eg., communication numbers, comnujnication times, 

35 periods of time for comnumk^ation, communication part- 
ner terminal numbers, abbreviations of the names of 
partner terminals, used media and conmunication 
charge. 

Rg. 3 shows details of the flow chart of Rg. 2 and 

40 Rg. 4 shows the content of information stored in tiie 
memory 104. 

In step S21 . the system conti'ol unit 10 monitors to 
determine whether or not calling or incoming through 
the line interface unit 13 has occun-ed. If there is no call- 

45 ing or incoming, this step is repeated until catling or 
incoming takes place. If there is a calling or incoming, 
the process proceeds to step 822 and a transmis: 
sion/reception number,_used media, a partner's tele- 
phone number and an abbreviated partner*s name are 

so stored in the memory 104 as shown in Rg. 4. In the 
operation of step 822, information on each medium is 
stored if a plurality of mediums are used. 

In step ^3. determination is made as to whether or 
not the contents of all used media have been registered 

55 in the memory 104. The process proceeds to step 824 
if they have been registered, or returns to step S22 if 
they have not been registered. 

That is. in a case where botii voice and image 
media are used for communication with the partner, the 
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communication contents are stored in the memory while 
separating the used media in accordance with the 
media categories, image and voice. 

In the case of fSDN communication, calling and 
incoming is effected through channel D (control chan- 
nel) and information on the partner's telephone nuntoer 
and the abtxeviated partner's name is sent through 
channel D. In step S24. the system control unit 10 mon- 
itors to determine whether or not communication 
through a channel B (information channel) has actually 
been started. t1 No. step S24 is repeated until communi- 
cation is started. If Yes, the process proceeds to step 
S25 and the start time is stored in the memory 1 04. 

In step S26, the system control unit 10 monitors to 
determine whether or not communication through chan- 
nel B has been completed. If No. step S26 is repeated 
until the communication is completed. If Yes. the proc- 
ess proceeds to step S27 and the period of time for 
communication and a communication charge are stored 
in the memory 104. In the case of ISDN communication, 
communication termination is controlled through chan- 
nel D and information on communication charge is sent 
through channel D. 

Start times and communication periods are stored 
with respect to communications of the same communi- 
cation number, and communication charges are stored 
with respect to media based on the notification through 
channel D. as shown in Rg. 4. 

Next, a procedure for outputting communication 
reports in response to an instruction sent from the oper- 
ation unit 9 an operator will be described below with 
reference to the flow chart of Fig. 5. 

If outputting communication reports is requested, 
the system control unit 10 determines in step S3 as to 
whether or not the whole communication history has 
been processed to form a communication management 
report with respect to each medium. If No. processing 
for forming communication management reports on 
non-processed conrtmunication history is performed in 
steps 85. S6. and 87. Ck>mmuntcation reports formed in 
these steps enable management of communication on 
each medium. In step 85. communications on voice 
media are extracted from the memory 1 04 arxJ process- 
ing for forming a voice communication management 
report is effected. In step 86. communications on data 
media are extracted from the memory 104 and process- 
ing for forming a data communication management 
report is effected. In step 87. communications on image 
media are extracted from the memory 1 04 and process- 
ing for forming an image conrvnuntcation management 
report is effected. The process tiiereafter retums to step 
83. 

If Yes in step 83. that is. tiie whole processing his- 
tory has k>een processed to form communication man- 
agement reports, communication management reports 
on management with respect to media are output from 
the output unit 1 1 in step 84, and the process is termi- 
nated. Fig. 6 shows examples of output communication 
management reports. 



In the above-desaibed embodiment, the operation 
of grouping communication management reports with 
respect to media is performed at the time of formation of 
communication management reports. However, tiiis is 

5 not exclusive and this operation may be performed at 
tiie time of collection/storage of communication history. 

The format of output communication reports in 
accordance witii the present invention is not United. 
Communication management reports may be output 

10 separately witii respect to media as in tiie case of tfie 
described embodiment or tiie communication reports 
may be output in a format witiiout being separated with 
respect to media such that management can be per- 
formed collectively with respect to all mecfia. 

15 In the above-described embodiment, media are 
grouped into tiiree categories: image, voice and data. 
However, "voice" can be sorted Into sub divisions, for 
example, speech. 3.1 kHz audio, and 7 kHz audio. Also, 
"image" can be sorted variously, for example, it is sorted 

20 into animated image and still imaga 

As described above, tiie multi-media communica- 
tion apparatus in accordance with the present invention 
is characterized by including memory means for collect- 
ing and storing communication history with respect to 

25 communication on each medium, a formation means for 
forming a communication management report on man- 
agement witii respect to each medium, and an output 
means for outputting communication management 
reports formed by tiie formation means. 

30 A communication management report on manage- 
ment wltti respect to each medium is thereby automati- 
cally formed and output, thereby enabling management 
of communication charge such that the overall commu- 
nication cost and the communication cost witii respect 

35 to each medium are calculated. 

According to tiie present invention, past communi- 
cation history can easily be referred to and it is therefore 
possible to improve the facility with which communica- 
tion is performed. 

40 In a case where a caretaking function is provided. 
^ incoming during operator's absence can be reconjed by 
outputting a communication management report 

[Second Embodiment] 

45 

Next, an example of outputting a communication 
report with respect to media used for connmunication 
wHh the partner^s communication apparatus in accord- 
ance with a second embodiment of the present inven- 

50 tion will be described below. It is possible to set seven 
modes of using media: a frst mode In which tiiree 
media, voice, data and image, are used: a second mode 
in which two media, voice and data, are used; a third 
mode In which two media, voice and image, are used; a 

55 fourth mode in which two media, data and Image, are 
used; a fiftii mode in which only voice is used; a sixtti 
mode in which only data is used; and a seventh mode in 
which image is used. 

Fig. 7 shows a process of storing communication 
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history in accordance with the second embodiment, and 
Fig. 8 shows a state of storage in memory 104, 

In step S31, system control unit 10 monitors to 
determine whether or not any calling or incoming 
through line interface unit 13 has occurred. If there is no 
calling or incoming, this step is repeated until calling or 
incoming takes place. If there is a calling or incoming, 
the process proceeds to step S32 and a transmis- 
sion/reception nun^er, used media, a partner's tele- 
phone number and an atsbreviated partner's name are 
stored in memory 104. 

If the used mediums are voice and image, "1 " Is first 
written in cells "voice" and "image" for used media, as 
shown in Fig. 8. (In cells for used media "data", the con- 
tent is changed from "0" to "1" by subsequently adding 
data by communication.) 

In step 833, system control unit 10 nwnitors to 
determine whether or not communication through chan- 
nel 6 (information channel] has actually been started. If 
No, step S33 is repeated until communication is started. 
If Yes. the process proceeds to step S34 and the start 
times with respect to voice and image are stored in 
memory 104. 

In step S35, system control unit 10 monitors to 
determine whether or not communication through chan- 
nel B has been completed. If No. the process proceeds 
to step 836 to determine whether or not the communi- 
cation mode has been changed. If the communication 
mode has been changed, the process returns to step 
832. If "data" is added to communication media, the 
content in the cell for used medium "data" is changed to 
"1" and the data transmission start time is stored (Fig. 
8), in steps 832 to 834. 

When the communication is completed, the proc- 
ess proceeds to step 837 to store in memory 104 the 
media mode determined from the media used last, the 
periods of time for communication and communication 
charges, thereby completing tiie process. In the case of 
I8DN. communication termination is controlled through 
channel D and information on communication charge is 
sent through channel D. 

Fig. 9 shows a flow chart for report outputting. After 
report outputting has t^een requested, determination is 
made in step 841 as to whether or not a mode number 
input from the operator has been received. In the case 
of No, the process proceeds to step 844 to edit a report 
for each mode number. That is, information with respect 
.all the niode. numbers,. such as information in mode 1 
and information in mode 2. is edited. In step 843. the 
reports are output in order of the mode numbers. 

Fig. 10 shows examples of output reports edited 
from the memory contents shown in Fig. 8. 

If it is determined in step 841 that a mode number 
has been input after tiie report output request the proc- 
ess proceeds to step S42 to edit a report with respect to 
the input mode number. In step 834, tiie report with 
respect to the input mode number Is output. That is. if 
"1" Is input as a mode number, reports on communica- 
tions using three media, voice, data and image. Is out- 



put. 

Thus, in tiie second emtxxiiment, a communication 
report formed for each medium for communication can 
be output and it is possible to easily confirm tiie medium 
5 used for one-time communication, the communication 
period and the communication charge witii respect to 
each medium. 

Further, according to the second embodiment it is 
also possible to recognize media at least available for 
10 the partner's apparatus. For example, a report with 
respect to mode l is output, terminals capable of three 
kinds of communication using voice, data and Image. 

[Third Emtxxiiment] 

75 

An example of outputting a communication man- 
agement report with a received image in accordance 
with a tiiird embodiment of the present invention will be 
described below. 

20 Rg. 11 is a block diagram of a multi-media commu- 
nication apparatus 101 in accordance with the third 
embodiment. The multi-media communication appara- 
tus 101 includes a handset 102 provided as a voice 
(audio) input/output means, and a voice control section 

25 103 having a voice (audio) encoding/decoding section 
for encoding various voice (aucfio) signals to be trans- 
mitted and for decoding received voice signals, an 
on/off-hook detection section, and a voice (audio) inter- 
face section for generating various tones. 

30 The apparatus 101 also includes a data ternfiinal 
104 for data communication, a data control section 5 
arranged to perform data transmission/reception witti 
the data terminal 104. a camera 106 provided as an 
image (video) input means, a display unit 107 for dis- 

35 -playing an input image supplied from the camera 106. 
an image received tiirough a line 1 15, operation display 
windows and the like, and an image (vkJeo) control unit 
108 having an image (video) encoding/decoding section 
for encoding image (video) signals to be transmitted 

40 and for decoding received image signals, and a video 
interface section for changing or dividing display win- 
dows of the display section 7. 

The apparatus 101 further includes an operation 
unit 109 having a keyboard, a touch panel or the like for 

45 inputting for overall control of tiie apparatus 101, a sys- 
tem control unit 110 having a CPU 1 10a, a ROM 110b, 
a RAM 1 10c and a memory (not shown) and serving to 
control and observe the whole of the apparatus 101 or 
to execute various application programs, and a memory 

so unit (memory means) 111 for storing communication 
history and a communication partner's image proc- 
essed by the image control unit 108. 

In the system control unit 110. communication his- 
tory is collected at the time of communication, the com- 

55 munication history Is stored in the memory 111 along 
with the received partner's image, and a communication 
management witii the partner's image is formed and is 
output by the output unit (output means) 1 12. Thus, the 
system control unit 1 1 0 has a formation means for form- 
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ing a management report. 

The apparatus 101 further includes a multiplex/sep- 
arator unit 113 lor multiplexing a voice signal from the 
voice control unit 103, data from the data control unit 
1 05 and an image signal from the image control unit 1 08 
and for separating reception frames received through 
the line 115 with respect to media, a line interface unit 
114 for controlling the line in accordance with the ISDN 
user network interface, and a line 1 15 for connection to 
the ISDN. 

A process of storing communication history and a 
partner's image effected for each communication by the 
thus-constructed multi-media communication apparatus 
will be described below with reference to the flow chart 
of Fig. 12. 

In step S51 . the system control unit 110 monitors to 
determine whether or not calling or Incoming through 
the line interface unit 114 has occurred- If there is no 
calling or incoming, step S51 is repeated until calling or 
incoming takes place. K there is a calling or incoming, 
the process proceeds to step S52 and a transmis- 
sion/reception number, used media, a partner's tele- 
phone number and an abbreviated partner's name are 
stored in the memory 111. 

In the case of ISDN communication, calling and 
incoming is effected through channel D (control chan- 
nel) and information on the partner's telephone number 
and the abbreviated partner's name is sent through 
channel D. In step S53. the system control unit 110 
monitors to determine whether or not communication 
through channel B (information channeO has actually 
been started. If No. step S53 is repeated until communi- 
cation is started. If Yes. the process proceeds to step 
S54 and the start time is stored in the memory 111. 

in step S55. the partner's image sent from the other 
end of the line is stored. That is, it is processed by the 
image control unit 108 and is thereafter stored in the 
memory 111. 

In step 856. the system control unit 1 10 monitors to 
determine whether or not communication through chan- 
nel B has been completed. If No. step S56 is repeated 
until the communication is completed. If \fes, the proc- 
ess proceeds to step 357 and the period of time for 
communication and a communicatton charge are stored 
in the memory 1 1 1 . In the case of ISDN communication, 
communication termination is controlled through chan- 
nel D and infomiation on communication charge is sent 
through channel D.- - 

Communication history and partner's images are 
stored in the memory 111 by this communication his- 
tory/partner's image storing process, as shown in Fig. 
1 5- That is. communication history data 111-1 including 
communication numbers, used media, partner's tele- 
phone numbers, abbreviated partner's names, (commu- 
nication) start times, communication periods and 
communication charges is stored in a table form such 
as that shown in an upper section of Fig. 15. while part- 
n^'s image data 1 11 -2 is stored in a block form shown 
in a lower section of Fig. 5. 



The operation of storing a partner's image in step 
S55 will be described below based on the fbw chart of 
Fig. 13. 

The operation unit 109 is provided with a memory 
5 key 109a (first operation means) for manually storing a 
received partner's image. In step S61, determination is 
made as to whether or not the memory key 109a of the 
operation unit 109 has been depressed. If No, the proc- 
ess proceeds to step S62. The system control unit 110 
10 has a time monitoring means for automatically storing a 
partner's image, whereby, in step S62, determination is 
made as to whether or not a certain length of time has 
elapsed after the start of communication. If No. the 
process returns to step S61 and the above determine- 
rs tion operation is repeated. 

It is determined in step S61 that the momory key 
109a has been depressed, or it is determined in step 
862 that the certain length of time has elapsed, the 
process proceeds to step 863 and the partner's image 
20 sent from the other end of the line is processed by the 
image control unit 108 and is thereafter stored In the 
memory 111. thereby completing the process. 

Next, a process of forming a communication man- 
agement report based on the communication history 
25 data 111-1 and partner's image data 1 1 1-2 stored in the 
memory 111 as shown in Fig. 14 and outputting the 
report will be described below based on the flow chart of 
Fig. 4. 

The operation unit 109 is provided witii a report key 

30 109b (second operation means) for manually starting 
formation of a communication management report and 
outputting tiie formed report. In step 861 . detemiination 
is made as to whether or not the report key 109b of tiie 
operation unit 109 has been depressed. If No. the proc- 

35 ess proceeds to step S62 and detemrunation is made as 
to whether or not calling or incoming takes place in the 
line interface unit 1 14. If it is thereby determined that no 
calling or incoming takes place, the process returns to 
step 861 and the above determination operation is 

40 repeated. 

If it is determined in step 862 that calling or Incom- 
ing has taken place, the process proceeds to step 863 
and the oommunication history and the partner's Image 
are stored as in steps 852 to 857 of Fig. 12. 

45 The system control unit 1 1 0 Is provided with a com- 
munication number management means for automati- 
cally outputting a communication management report, 
whereby, in step 864, determination is made as to 
whetfier or not the number of communications has 

so reached a predetermined number. If No, the process 
returns to step S61. 

If it is determined in step 861 that the report key 
109b has been depressed or it is determined in step 
864 that the predetemined number of communications 

55 has been reached, tiie process proceeds to step 865 to 
fbmi a oommunication management report In this case, 
communication history data 111-1 and partner's image 
data 111-2 stored in the memory 1 1 1 as shown in Fig. 
15 are combined in accordance v^th the stiandard for- 
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mat with respect to each communication to form a com- 
munication management containing the partner's 
image, such as that shown in Fig. 16. In step S66, the 
communication mangement report formed in step S65 
is output by the output unit 12. thereby completing the 
process. 

In this embodiment, communication numbers, used 
media, partner's telephone numbers, abbreviated part- 
ner's names, (communication) start times, communica- 
tion periods and communication charges are included 
as items of communication history. Howe^/er, other com- 
munication history items, e.g., communication modes, 
speech. 3.1 kHz audio, and 7 kHz audio, and communi- 
cation error codes may be used as information for com- 
munication management reports. 

Ordinarily, partner's images output in communica- 
tion management reports are still images. However, 
images used the multi-media communication apparatus 
are not limited to still images and may include animated 
images. If an animated image is used, it is converted 
into a still image in the multi-media communication 
apparatus after being sent from the partner's apparatus. 

In the above-described embodiment, the number of 
partner's image storing time is limited to one. However, 
partner's images may be stored a plurality of times by 
depressing the memory key 109a. 

The above-descnt>ed embodiment is limited to the 
process of actual communication. However, the multi- 
media communication apparatus in accordance with the 
present invention may have a caretaking function such 
that the above-described process is automaticalty con- 
ducted for incoming during operator's absence. 

As described above, the multi-media communica- 
tion apparatus in accordance with the above embodi- 
ment is ananged to output a communication 
management report with a partner's image, thereby 
making it possible to easily refer to past communication 
history. Since communication partner's face or the like is 
added to the communication history, it is possible to 
identify the communication partners and the communi- 
cation times easily and positively. 

In the multi-media communication apparatus in 
accordance with the above embodiment, a partner's 
image can be stored automatically or manually. It is 
thereby possible for the operator to store the partner's 
image to be recorded on a communication report with- 
out toeing conscious of this operation as well as to store 
and record an ait»trary partner's image on a communi- 
cation report 

In the multi-media communication apparatus in 
accordance with the above embodiment, a communica- 
tion management report can be formed by combining 
communication history data and partner's image data. 

In the multi-media communication apparatus in 
accordance with the above embodiment, the operation 
of outputting a communication management report can 
be started automatically or manually. It is therefore pos- 
sible for the operator to output communication manage- 
ment reports without failure and to output them at any 



time. 

Further, the multi-media communication apparatus 
in accordance with the above embodiment has an auto- 
matic response function (caretaking function) such that 

5 a communication management report with a partner's 
image is output in the case of incoming during opera- 
tor's absence, thereby providing an incoming record 
containing an image of the partner's face. It is thereby 
possible to easily and positively identify the terminal 

10 from which the incoming is received. 

Claims 

1. A multi-media communicatbn apparatus conrp-is- 
15 ing: 

communication means (3. 5. 8. 12, 13) for a 
communication with a partner's communication 
apparatus on each of kinds of media including 
20 video signal, voice and data; 

memory means (103) for storing information on 
each communication; 

formation means (101) for forming a communi- 
cation management report (Fig. 10) corrtaining 

25 the information on each communication stored 

by said memory means; and 
output means (1 1) for outputting the communi- 
cation management report formed by saki for- 
mation means, characterized in that 

30 said formation means (101) forms the commu- 

nication management report (Rg. 10) in such a 
form as an operator can understand a plurality 
of media information used in one communica- 
tion. 

35 

2. An apparatus according to Claim 1, wherein the 
communication management report outputted by 
said output means (11) describes the plurality of 
media infornriation used in one communk^ation. 

40 

3. An apparatus according to Claim 1. further com- 
prising designation means (9) for designating out- 
putting of tiie communication management report, 
and 

45 wherein said output means (11) outputs tiie 

comrrajnication management report in accordance 
with the designation by said designation means (9). 

4. An apparatus according to Claim 3, wherein said 
so formation means (101) forms the communication 

management report by using, as a parameter, at 
least one of the media which can be used for com- 
munication by sakJ communk^ation means. 

55 5. A multi-media communication method comprising: 

a communk:ation step (S31, S33, S35) of per- 
forming a comnrtunication witii a partner's com- 
munication apparatus on each of kinds of 
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media induding video signal, voice and data; 
a storage step (S32) of storing information on 
each communication; 

a formation step (S42, S44) of fomiing a com- 
munication management report (Fig. 10) con- s 
taining the information on each communication 
stored in said storage step; and 
an output step (S43) of outputting the commu- 
nication management report formed in said for- 
mation step, characterized in that io 
said formation step (S42. S44) forms the com- 
munication management report (Fig. 10) in 
such a form as an operator can understand a 
plurality of media information used in one com- 
munication. 15 
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